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Abstract 

Khanna and Sudan [4| studied a natural model of continuous time channels where signals are corrupted by the 
effects of both noise and delay, and showed that, surprisingly, in some cases both are not enough to prevent such 
channels from achieving unbounded capacity. Inspired by their work, we consider channels that model continuous 
time communication with adversarial delay errors. The sender is allowed to subdivide time into an arbitrarily large 
number M of micro-units in which binary symbols may be sent, but the symbols are subject to unpredictable delays 
and may interfere with each other. We model interference by having symbols that land in the same micro-unit of time 
be summed, and we study fc-interference channels, which allow receivers to distinguish sums up to the value k. We 
consider both a channel adversary that has a limit on the maximum number of steps it can delay each symbol, and a 
more powerful adversary that only has a bound on the average delay. 

We give precise characterizations of the threshold between finite and infinite capacity depending on the in- 
terference behavior and on the type of channel adversary: for max-bounded delay, the threshold is at D milx = 
O (AI log (min{fc, M})), and for average bounded delay the threshold is at D Mg — O (yB mm{k, M}\ . 

1 Introduction 

We study continuous time channels with adversarial delay errors in the presence of interference. Our models are 
inspired by recent work of Khanna and Sudan [4|, who studied continuous-time channels in the presence of both delay 
errors and (signal) noise errors. In this model, the communicating parties can subdivide time as finely as they wish. In 
each subdivided unit of time a or 1 can be sent, but the sent signals are subject to unpredictable delays. Khanna and 
Sudan found (suprisingly) that the channel capacity in their model is finitely bounded only if at least one of the two 
sources of error (delay or signal noise) is adversarial. However, they assumed that at any instant in time, the receiver 
observes the sum of the signals delivered. 

In this paper, we observe that the behavior of the channel changes dramatically if one accounts for the possibility 
of interference, and that this holds even in the absence of signal noise. Our model of interference is very simple; the 
symbols received at each time unit are summed, and the receiver sees the exact sum if it is less than k, but values 
greater than k cannot be distinguished from each other. 

At a high level, our results are two-fold. First, we show that delay errors in the presence of interference are 
surprisingly powerful. Second, in the context of delay errors with interference, we find that seemingly innocuous 
modeling decisions can have large effects on channel behavior. 

Related Work. Typically a communication channel is modeled as follows. The channel takes as input a signal /, 
modeled as a function from some domain T to some range 1Z, and the channel outputs a received signal / : T — > 72, 
which is a noisy version of /. For discrete time channels, T is a finite domain {0, . . . , T — 1} where T is the time 
duration, and for continuous-time channels, T is a continuous domain such as the interval [0, T}. For discrete signal 
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channels, 1Z is a finite set such as {0, 1}, and for continuous signal channels, 1Z is an infinite set such as the interval 

[0,1]. 

Shannon showed in the discrete time setting, the capacity of the channel is finite even if the signal is continuous, 
as long as there is signal noise [6|. Nyquist [5] and Hartley [3| showed that even in the continuous time setting, the 
capacity is finite if one places certain restrictions on the Fourier spectrum of the signal. 

Most relevant to us is recent work by Khanna and Sudan [4|, which introduced continuous-time channels with 
signal noise and delay errors. They modeled their channel as the limit of a discrete process, and found that the 
capacity of their channel is infinite unless at least one of the error sources is adversarial. 

Our work differs from previous work in several ways. We consider channels which introduce delays adversarially, 
but we additionally consider a very simple model of interference. We also consider two limitations on the adversary: 
one where maximum delay for any symbol is bounded, and one where the average delay over all symbols is bounded. 
In both cases, we find that our channels display a clean threshold behavior. 

We believe that the adversarial setting presented here offers a clean initial analysis of the interference model, 
already with surprising results. A next natural step would be to analyze the effect of random delays in the presence of 
interference, and we leave this question as an interesting direction for future work. 

2 Model and Summary of Results 

Modeling Time. Following j4), we model continuous time as the limit of a discrete process. More specifically, the 
sender and receiver may send messages that last a duration of T units of time, but also can divide every unit of time 
into M subintervals called micro-intervals, and the sender may send one bit per micro-interval. We refer to M as the 
granularity of time, and refer to a sequence of M micro-intervals as a macro-interval. We call T the message duration 
of the channel. A codeword c sent over the channel is therefore represented as c g {0, 1} MT . 

Modeling Delays. The effect of the channel on a sent codeword c G {0, 1} MT is to delay symbols of c by some 
amount, e.g. the ith symbol of c may be moved to the jth timestep of the received codeword, where j > i. The delay 
process is adversarial, where we assume that the adversary knows the encoding/decoding scheme of the sender and 
receiver, and both the symbols that get delayed and the amount they are delayed can depend on the codeword that is 
sent. We formalize the notions of max-bounded delay and average-bounded delay below. 

Modeling Interference. If multiple symbols are delivered at the same time step, there are several natural ways the 
channel could behave. In |4|, the receiver observes the sum of all bits delivered at that instant of time; we call this the 
sum channel. Another obvious choice is for the receiver to see the OR of all bits delivered at that instant in time; we 
call this the OR channel. 

We generalize these two models to what we call the k-interference channel. If there are fewer than k Is delivered 
at an instant in time, the receiver will see the exact number of Is delivered; otherwise the receiver will only see that 
at least k Is have arrived. Thus, the sum channel can be viewed as the oo -interference channel, and the OR channel 
as the 1 -interference channel. We consider fc-interference channels as k varies between the extremes of 1 and oo, and 
may depend on the granularity of time M. We call the parameter k the collision resolution of the channel. 

Valid Codebooks. For any fixed channel and codeword c, we let B(c) denote the set of possible received strings 
corresponding to c. For any time T, we say a codebook C C {0, 1} MT is valid for a channel if for any c ^ c! in C, 
B(c) n B(c') = 0. Informally, this means that the adversary cannot cause the decoder to confuse c with c' for any 
other codeword c'. 

Rate and Capacity. For any fixed granularity of time M and time T, let sm.t '■= log \C(M, T)\, where |C(M, T)\ 
denotes the size of largest valid codebook C(M,T) C {0, 1} MT for the channel. The capacity of the channel at granu- 
larity M is defined as R(M) = limsupy^^jsA/.T/T 1 }- The capacity of the channel is defined as limsup^^^ R(M) = 
lim sup jvf-voo [lim supj^^ {sm,t/T}]. We stress that the order of the limits in the definition of the channel capacity 
is crucial, as we show in Section 

Encoding: For every T and M, the sender encodes st.m bits as MT bits by applying an encoding function Et : 
{0, 1} s t.m _> {0, 1} MT . The encoded sequence is denoted Xi,..., X MT . 
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Delay: The delay is modeled by a delay function A : [MT] — > Z-°, where Z-° denotes the non-negative integers. 
The delay function has to satisfy a constraint depending on the type of delay channel we have: 

• Max-bounded delay: For all i € [MT], A(i) < D mdx , where D m . dx is the bound on the maximum delay. 

• Average-bounded delay: ^ ■ A(i) < MT ■ D mg , where D dvg is the bound on the average delay. 

Received Sequence. The final sequence seen by the receiver given delay A, is Y\, . . . , Ymt € Z-°, where Yi :~ 
minjfc, X)j<i s t j+A(j)=i Xj} and k is the collision resolution parameter of the channel. We will ignore the symbols 
that get delayed past timestep MT. 

For brevity, we use the shorthand AVG-fc channel and MAX-fc channel, where the meaning is clear. 

2.1 Summary of Results 

We prove that in the case of max-bounded delay, the capacity is finite if D m . dx = ft (M log (min{fc, M})), and 
infinite otherwise. In contrast, we prove that in the case of average-bounded delay, the capacity is finite if D mg — 



We also consider a number of variant channels and observe that seemingly innocuous modeling choices cause the 
behavior to change drastically. In particular, we consider settings where the granularity of time is allowed to grow with 
the message duration, and where adversarial signal noise can also be added. For brevity, we provide a few specific 
interesting results. 

3 Max-Bounded Delay Channel 

We give a precise characterization of the infinite/finite capacity threshold of the MAX-fc channel. Here and throughout, 
fc refers to the collision resolution paramater, and M to the granularity of time. 

Theorem 3.1. IfD max is the max-delay bound for the MAX-k channel, then then the capacity of the channel is infinite 
when D max = o (M log (min{fc, M})), and the capacity is finite when D max = ft (M log (min{fc, M})). 

Proof. Infinite capacity regime. Suppose D m . dx = cM log (minjfc, M}) for c = o(l) (here, c denotes a function of 
M that is subconstant in M). 

Assume for simplicity that 1 /c is an integer. Also assume that c > and k < M, as smaller values of c 

and larger values of fc only make communication easier. We give a valid codebook of size s = 2 T / 2c , showing 
R(M) = oj(1), and thus the capacity is infinite. Given a message x G {0, l} T ' 2c , the sender breaks the message x 
into blocks of length log fc. The sender then encodes each block independently, using 2cM log fc bits for each block as 
described below. The resulting codeword has length 2c ^ fc • 2cM log fc = TM as desired. 

A block is encoded as follows. Since each block is log fc bits long, we interpret the block as an integer y, 1 < y < fc. 
The sender encodes the block as a string of 2cMlogfc bits, where the first y < k bits in the string are Is, and all 
remaining bits are 0s. To decode the j'th block of the sent message, the receiver simply looks at the j'th set of 
2cM log fc bits in the received string, and decodes the block to the binary representation of y, where y is the total count 
of Is received in those 2cM log fc bits. 

Since the maximum delay is bounded by cM log fc, and Is only occur as the first k < M < cM log fc locations of 
each sent block, any 1-bit must be delivered within its block. Furthermore, the count of 1 bits is preserved, because at 
most fc 1 bits collide within a block. Correctness of the decoding algorithm follows. 

Finite Capacity Regime. Suppose the delays have bounded maximum D m . dx = cM log (min{fc, M }), with c = 0(1). 
We give an adversary who ensures that there at most (9(log fc) bits of information are transmitted every clog fc macro- 
timesteps. Thus, for c = 0(1), the rate is bounded above by 0{\) = 0(1) for all values of M, and hence the capacity 
is finite. 

Assume first that fc < M. The adversary breaks the sent string into blocks of length D max , and delays every sent 
symbol to the end of its block. The adversary clearly never introduces a delay longer than D m . dx micro-timesteps. 



nly/M ■mm{k,M}), and infinite otherwise. 
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Each received block can only take k + 1 values: all bits of the received block will be 0, except for the last symbol 
which can take any integer value between and k. Thus, only O(logfc) bits of information are transmitted every 
-Dmax = cM log k micro-timesteps, or c log k macro-timesteps, demonstrating finite capacity. 

If k > M, then the adversary is the same as above, where the block size is D max = cM log M. Each received 
block can only take one of cM log M + 1 values, since all bits of the block are 0, except for the last symbol which may 
vary between and cM log M, Thus, only log(eM log M) = 0(c log M) bits of information are transmitted every 
c log M macro-timesteps, completing the proof. □ 



4 Average-Bounded Delay Channel 

We now study the behavior of the AVG-fc channel. 

Theorem 4.1. If D avg is the average-delay bound for the AVG-k channel, then then the capacity of the channel is 
infinite when D avg = o(y / M min{/c, M}), and the capacity is finite when D avg — fl(y // M min{k, M}). 

Proof. Infinite capacity regime. Suppose D avg = c\/Mk, where c = o(l) (that is, again, c is a function of M that 
is subconstant in M). Let T be the message duration. Assume without loss of generality that c > -Xt and k < M 
(smaller values of c and larger values of k only make communication easier). 

Suppose the sender wants to send a message x € {0, 1} ST . M with st,m = T/c. As in [4 Lemma 4.1], we use a 
concatenated code: we assume that x has already been encoded under a classical error-correcting code C that corrects 
a 1/5-fraction of adversarial errors (or any other constant less than 1/4), as this will only affect the rate achieved by 
our scheme by a constant factor. C is then concatenated with the following inner code, which is tailored for resilience 
against delay errors: each bit of x gets encoded into a block of length 2£ — 2cM: 0's map to 2£ 0's (called a 0-block), 
and 1 's map to £ l's followed by £ 0's (called a 1-block). The resulting codeword is thus MT symbols long as required. 

For decoding, let Y = Y% , . . . , Y"mt be the received word. The receiver divides Y into blocks of length £ . Let 
7(0 = Tlje[iMT (i+i)MT-i] denote the number of Is encountered in the ith block. The receiver decodes Y as 
a message y g {0, 1} Stm where yi is declared to be 1 if 7(1) > \JTk, otherwise. Notice VJk > 1. Finally, the 
receiver will decode y using the outer decoder to obtain the original message. By the error-correcting properties of the 
outer code C, it suffices to show that at least 4/5ths of the inner-code blocks get decoded correctly. 

We use a potential argument to demonstrate that the adversary can afford to corrupt a vanishingly small fraction of 
the blocks. We maintain a potential function that measures the total amount of delay the adversary can apply after 
performing the ith action (where an action is delaying a single symbol some distance). Initially, $(0) = MTD avg . 

Turning a 0-block into a 1-block requires the adversary to delay at least y/Jk 1 symbols from some previous block 
at least a distance £/2, so this requires reducing $ by fl(£ 3 ^ 2 ^/k). To turn a 1-block into a 0-block, the adversary can 
either 1) move 1 symbols out of the 1-block (evicting Is), or 2) collide Is within the 1-block, or 3) a combination of 
both. We show that any combination requires reducing $ by n(£ 3 ^ 2 Vk) as well. 

Suppose the adversary chooses to corrupt a 1-block by evicting 5 1 symbols, and colliding the remaining 1 symbols 
so that at most \JTk Is remain. The adversary minimizes the amount of delays it spends to do this by evicting the last 5 
Is from a block, and choosing a equally spaced "collision points" (CPs) within the remaining Is, where each remaining 
1 symbol is delayed to the nearest CP ahead of it. Evicting S Is out of the block requires the adversary to spend at least 
S£ delays. Each CP receives (£ — S)/a 1 symbols, and the amount of delays spent per CP is 1 + 2 + ■ • • + {£, — 5) /a = 

(j^^—^j ■ Thus, the total amount of delay spent by the adversary to corrupt the 1-block is £1 ^^7^ — I - Si\ . This is 

minimized when S = 0, i.e. when no symbols are evicted. Since ak < ^/Tk (because each CP will have value k in the 
received string if at least k Is are delivered at that index), the adversary needs to use f2(£ 3 / 2 -\/&) units of potential in 
order to corrupt a 1 -block. 

In our analysis, the minimum potential reduction £!(£ 3 / 2 -\/fc) accounts for corrupting at most a block and its 
adjacent neighbor. Thus, the maximum number of blocks corruptable is 2$>{0)/n(£ 3 / 2 Vk) = 0{c(M/£) 3 / 2 T) = 
0(T/y/c). Since the original codeword had a total of T/c blocks, the maximum fraction of blocks corruptable is 
0(y/c). However, c = o(l), so a vanishingly small fraction of blocks are corrupted, and the original message can be 
recovered. Thus, we have constructed a valid codebook of size 2 n ( T / c \ and this implies that the capacity is infinite. 
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Finite capacity regime. Suppose the delays have bounded average Z? avg = c\J M min{£;, M}, for some constant c. 
We will assume for simplicity that c = 1 and k < M, and explain how to handle smaller values of c and larger values 
of k later. We show the capacity is finite by specifying an adversary who ensures that there are a constant number of 
possible received strings for almost every macro-timestep. 

To accomplish this, the adversary will break the sent string into blocks of length M. It scans the blocks sequentially, 
and adds and removes Is so that each block will have Is only at indices that are multiples of D dvg , or at the very last 
index of the block. The adversary ensures that it can always add Is when it needs to by maintaining a "bank" of 
delayed Is from previous blocks that will have size between Z? avg and 2D. dvg Is whenever possible. The bank will 
always be small enough so that it does not contribute too many delays to the average. Once the bank reaches size D avg , 
its size never falls below this level again. We show that the amount of information transmitted before the bank reaches 
this size is negligible for large T. 

The adversary considers each block in turn, and its actions falls into four cases. Let I denote the number of Is in 
the block, and let s denote the size of the bank at the start of the block. 

1. If I < D avg (we call the block light): 

(a) If s > D dvg + k — £, the adversary will delay all Is in the block until the final index within the block. If 
I < k, the adversary will also deliver k — I Is from the bank at the final index to ensure that the value of 
the final index is k. When this step completes, the size of the bank will be between D dvg and s . 

(b) If s < D avg + k — £, the adversary adds all Is in the block to the bank, ensuring that the received block 
consists entirely of Os. When this step completes, the bank has size least s and at most D dvg + k < 2D dvg . 

2. If t > D avg (we call the block heavy): 

(a) If s < -D avg , the adversary adds D dvg — s < i of the new Is to the bank, and it delays the rest of the Is to 
the nearest integer multiple of D dvg . 

(b) Otherwise, s will be at least D dvg . The adversary will place k Is at every location which is an integer 
multiple of D avg using bits from its bank (this requires at most kM/D dyg = kMj\/kM = D dYg bits), and 
delays the first I — D mg Is within the current block to the nearest integer multiple of D avg . The last D avg 
Is get added to the bank to replace the Is lost from the bank, so the bank stays at size s. 

We argue that at most \J Mk log k + 0(T) bits of information are transmitted over T blocks by the above scheme. 
Once the bank reaches size D dvg , there are only three possible values for each received block: the all-zeros vector; the 
vector that is all Os except for the final index which has value k; and the vector that is all Os except for indices which 
are integer multiples of D dvg , which have value exactly k. Before the bank reaches size -D avg , any light block is still 
received as either the first or second possibility just described. Finally, at most one heavy block is encountered before 
the bank reaches size -D avg , and this block can take on at most k M l D '^ < k yP ^ possible values. Thus, over all T 
blocks, at most VMk log k + 0(T) bits of information are transmitted, and hence the capacity is finite. 

Finally, we bound the average delay incurred by the adversary. For each block, we separately bound the total 
delays incurred by the symbols banked at the beginning of the block and symbols within the block. The symbols 
within any light block are responsible for total delay at most MD mg , since at most D avg symbols are delayed at most 
M. The symbols within in any heavy block are responsible for total delay at most 2MD dvg , since all but at most 
D dvg Is are delayed only until the nearest integer multiple of D dvg , and the rest are delayed at most M. As the bank 
contains at most 2D dvg Is, banked symbols contribute at most 2MD dvg total delays per block. The adversary therfore 
spends at most 4MD dvg total delays per block, for an average delay of 4Z? avg . To reduce this to D dvg , we modify the 
above construction to use a block length of M/16 micro-timesteps, decreasing the average delay appropriately while 
increasing the rate by only a constant factor. 

It remains to explain how to handle cases c < 1 and k > M. If c < 1, we simply decrease the block size 
further, from M/16 to Mc 2 /16. This decreases the average delay by a factor of c and increases the rate by only a 
constant factor. For k > M, we note the adversary described above never delivers more than M Is at any particular 
micro-timestep. Thus, even if k > M, the the received string is the same as it would be if k = M. □ 
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5 Extensions and Alternative Models 



5.1 The Order of the Limits Matters 

Under the definition of capacity used in the sections above and in fl4) , \ims\rp AI ^ 00 \imsup T _^ oc {k]\j y T /T}, the 
sender and receiver are not allowed to let the granularity of time grow with T. If we instead define the capacity to 
be limsup T _ i . 00 ]haaVLp M ^ t . aa {kM,T /T}, then the channel would behave very differently. Conceptually, the reason 
is that if M is allowed to grow with T, the sender and receiver can choose M to be so much larger than T that a vast 
amount of information (relative to T) can be encoded in just the first macro-timestep, avoiding interference issues. 

To demonstrate one place where this interchange of limits alters the channel capacity, we show the AVG-1 channel 
behaves differently under this definition. 

Theorem 5.1. If one interchanges the order of limits in the definition of channel capacity, then the capacity of the 
AVG-1 channel with D avg — o(M) is infinite. 

Proof. The idea is that the sender encodes u)(l) bits of information via the location of the first 1 in the entire codeword. 
More formally, suppose D avg = cM — 1 with c = o(l), and let d = \/c/2. Assume for simplicity that Md is an 
integer. We will construct a valid codebook C C {0, 1} MT with \C\ = 0(l/c') = w(l) such that for each message 
x € C, the last T — 1 macro-timesteps consist only of Os. Thus, we only specify the first macro-timestep in each 
codeword x. In the first codeword, the first macro-timestep will simply be Mc' Os followed by M — Md Is. In the 
second codeword, the first macro-timestep will be 2Md Os followed by M — 2Md 1 s. In general, in the ith codeword, 
the first macro-timestep will be iMd Os followed by M — iMd Is. 

The decoder will look at the position L of the left-most 1 in the received string and output the largest i such that 
iMd < L. 

In order for the adversary to force the decoder to decode incorrectly, the decoder has to make the first 1 appear 
at least d ■ M positions later than it does in the sent string. For this to happen, the adversary has to spend at least 

1 + 2 H h Md > M 2 c /2 /2 delays in total. So the average delay has to be at least M^- = For fixed T, this is 

n(M). " ' □ 

5.2 Adding noise 

In this section we note that the combination of interference with noise yields a max-bounded adversary that is surpris- 
ingly potent. 

Theorem 5.2. Suppose the adversary is allowed to flip t bits per macro-timestep, and delay each bit a maximum of 
D max micro-timesteps. Then the capacity of the 1 -interference channel is finite if D max ■ t — Q(M), and is infinite if 
Dmax • t = o(M). In particular, the capacity is finite if t — D max — Cl(y/~M). 

Proof. Finite capacity regime. Suppose for simplicity that D m - dx ■ t = M, The key observation is that the adversary 
can turn any macro-timestep into the unique string consisting of all zeros, except for Is at indices which are integer 
multiples of D max , while staying within its budget. The adversary breaks each macro-timestep into t blocks of length 
-Dmax, and delays each bit to the end of its block. If no Is are sent in a block, the adversary flips a single bit in the 
block to create a 1 . This totals at most t bit-flips per macro-timestep, giving the result. 

Infinite capacity regime. Suppose D max ■ t = o(M). We again use a concatenated code to construct a valid codebook 

of size 2 ^ D m» ' . The sender starts with a string x € {0, 1 } D m»+ 1 encoded under a classical error-correcting code with 
constant rate which can tolerate up to a 1/5 fraction of adversarial errors. 

The sender then replaces each bit of x with a block of length Z) max + 1: if n = 0, the i'th block is set to the 
all-zeros string, and if x\ = 1, the i'th block is set to the string consisting of a 1 followed by -D max zeros. The decoder 
decodes a block to 1 if the block contains at least one 1, and decodes a block to otherwise. It suffices to show that at 
least a 4/5 fraction of the blocks get decoded correctly. 

Call a block dirty if even a single bit within it is flipped, and call the block clean otherwise. Since the adversary 
can afford to flip only T ■ t = o{jp-) bits of the course of the entire message, only an o(l) fraction of blocks are 
dirty. For any clean block, the adversary cannot afford to delay the first bit in the block beyond the final bit in the 
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block. Thus, any clean block will get decoded correctly. It follows that decoding will always be successful, yielding 
the result. □ 



6 Discussion 

We studied a variety of natural models for continuous-time channels with delay errors in the presence of interference. 
Our results show that these channels exhibit a clean threshold behavior. We note our finite capacity results hold even 
for computationally simple adversaries in the sense of Gurus wami and Smith [2|; that is, our adversaries process the 
sent string sequentially in linear time, using just 0(M) space. Our results can be viewed as a counterweight to those of 
Khanna and Sudan [4|, by showing that other natural additional restrictions can lead to finite capacity in their model. 

Many questions remain for future work. Our results only address adversarial delays; random delays under our 
interference model remains open. One might also consider different models of interference, or different limitations on 
the delays introduced by the adversary. 
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